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The degree of relationship between observed faculty 
personal characteristics and judged teaching effectiveness vas 
investigated. Students in a liberal arts coll^^ge rated faculty on two 
typical teaching instruments and the Osgood Semantic Differential. 
Data cane from 1,500 stucent judgments on 108 (86 percent response) 
faculty. Factor analysis, analysis of variance, and multiple 
regression analyses showed that personality and teaching 
effectiveness are highly correlated (0.69), that Osgood factors can 
predict a multiple R=.88 for teaching effectiveness, and that 
dynamic, pragmatic, amicable, and highly int*^ ^ lectually competent 
faculty receive statistically significantly uxgher teaching 
competence ratings. (Author) 
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PERSONAL CHARACTERISTICS AND TEACHING EFFECTIVENESS OF COLLEGE FACULTY 
(Submitted for publication ^farch| 197A) 

Introduction 

Calls for Improved college teaching and a proper evaluation of 
faculty performance have a long history (Jordan, 1906; Wilson, 19A2; 
Eble, 1970). Apparently, however, the picas have failed to produce the 
desired results Today the cries are as Intense a& ever. They come from 
students feeling deprived of stimulating Instruction, from external sources 
demanding accountability of a professor's work, and from administrators and 
peers facing difficult academic staffing decisions. A tight and constrict- 
ed Job market focuses attention on promotion procedures, especially with 
re^^pect to awarding tenure. Teaching effectiveness is a principal criter- 
ion in the process of faculty evaluation. Hence, insights into factors 
affecting this criterion are needed for many good reasons. This study sup- 
plies data relevant to the assessment of faculty performance. The research 
examines the relationships among different dimensions of teaching behavior 
in terms of student ratings of ef fectiveneec and develops predictive cri- 
teria concerning student perceptions of effective college teachers. 

A major problem in evaluating teaching effectiveness stems from a lack 
of agreement on appropriate criteria (Mitzel, 1960: 1481; McKn^achie, 1969; 
Hlldebraud and Wilson, 1970). Part of this difficulty relates to research 
techniques which have not adequately established the relationship between 
personality characteristics and classroom teaching beliaviors. This study 
is based on the conceptual premise that effective college teaching depends 



less on faculty behaviors directed toward the functional management of a 
class and more on personality factors which students perceive to be relev- 
ant In the teaching/learning environment* Stated somewhat differently » an 
Instructor's skill In organizing and managing his course requirements Is a 
necessary but not sufficient condition for achieving effectiveness In the 
classroom. It Is the personal qualities which the Instructor as an^ Indi- 
vidual brings to the educational setting that spell the difference between 
success and failure as a teacher, at least Insofar as student judgments are 
concerned* 

The study was conducted at a typical liberal arts college* Data were 
obtained on two student evaluation forms and a semantic differential In- 
strument for 108 of the 125 member faculty* The college's Office of 
Institutional Research (IR) provided one set of student-Judged teaching 
effectiveness scores from the Institution's ongoing practice of evaluating 
Instruction* The IR Insttument assessed presentation of course content 
and Instructor's attitude toward students. Careful inspection of the items 
indicated a definite emphasis on the teacher's ability to develop positive 
interaction with students through the medium of the discipline* Students' 
ratings on this form reflected their perceptions of the instructor's skill 
in communicating subject matter andi in addition, his proficiency in 
facilitating the interaction process* In most cases instructors were rated 
by about 85% of their students. 

A student-run and published evaluation of faculty teaching effective- 
ness (Pequod) gave a second measure* Although similar in style to the IR 
form, Pequod differed substantially in content. This Instrument focused 
almost exclusively on functional aspects of the course, including concerns 



about fairness, relevance, and utility of the requirements. In this case, 
students' ratings were interpreted primarily as assessments of the instruct- 
or's organizational ability and the degree to which the legitimate functions 
of the classroom were carried out» The average number of raters per 
instructor for Pequod was 75* 

The third instrument on which students judged faculty was a semantic 
differential (Osgood). This measure was made up of 30 bipolar adjective- 
pair items descriptive of various personality characteristics* The form 
mixed adjective-pairs directly related to teaching (logical/llJ.oglcal, 
organized/disorganized) with those more associated with personal traits 
(bold/timid, warm/cold). Approximately 850 students rated faculty on the 
Osgood « 

The three measures — IR and Pequod on teaching effectiveness and Osgood 
for personal characteristics — were obtained over a one and one-half year 
interval. While some raters participated in all three assessments, others 
responded to only one of the instruments. Therefore, the three assessments 
of faculty possess appreciable independence both over time and among raters. 

In addition to descriptive statistics on each instrument, correlation 
coefficients , factor analysis, one-way analysis of variance, and multiple 
regression analyses of the data were obtained. The level of significance 
for F and t-ratios was set at ,05. 

Results 

1. In order to better interpret the Osgood criterion scores, faculty 
ratings on this instrument were examined using the factor analytic technique. 



Results are reported in Table 1. The 30 items comprising this criterion 
were factor analyzed using a principal-axis analysis with orthogonal ro- 
tation. A five-factor solution provided four distinct personality com- 
ponents; the fifth factor produced no item loadings above the cut-off 
score • 

A cut-off score of .45 on factor loadings was used to determine which 
items should be retained and which eliminated from the factors. No item 
appears in more than one factor,^ Factor scores were couiputed for each 
instructor by summing his mean student ratings on each of the items loaded 
at or above .45 on the various factors. 



Insert Table 1 about here 



Factor I was labeled "Personal Potency.'* Loadings on the eight items 
ranged from .84 to .54, the highest being those of aggressiveness, bold- 
ness, and extroversion. The personally potent teacher is seen as one who 
is highly attractive and who, by virtue of this attractiveness, is able 
to exert considerable influence over his students. The picture Ig that of 
a dynamic, out-going individual, who, at the same time, communicates well 
with students and has a relaxed attitude. The importance of these last 
two items must not be overlooked; without such tempering qualities, the 
profile would be one of brashness, bordering on the obnoxious — hardly the 
description of an influential individual. 

The two items comprising Tactor II were labeled "Pragmatism." Factor 
loadings in the mid-seventies were obtained for both the practicable/impracti- 
cal and predictable/unpredictable Items. This factor appears to indicate 



a "conunon-sense ' or "down-to-earth** dimension to the teaching situation 
which students perceive as an Important Ingredient Ih. effectiveness • 

i 
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The third factor, "Amicability,*' contains Items whi^h describe an 
Individual In terms of his friendliness and goodwill toward others. Inter- 
personal sensitivity Is apparent In this pattern of traits. Sensitiveness, 
openmlndedness> and acceptance on the part of faculty are espev")lally Im- 
portant to students as reflected In the factor loading of .76, .73, and 
.72 respectively. Reasonableness and graclousness, although less heavily 
loaded, are also attributes desirable for effective Interpersonal 
relationships. 

Finally, Factor IV Is made up of Iteme Indicative of a faculty 
member's "Intellectual Competency.** Clearly, expertise, knowledge, and 
wisdom are essential aspects of this concept which also Includes decisive- 
ness and stability as well as rational and sensible behavior. 

In considering the meaning of these derived factors. It Is important 
to point out that their InterpretaClon Is based essentially on subjective 
Judgment. Nevertheless, the factors obtained from this Osgood Instrument 
appear to resemble factors reported In previous research studies. Although 
each study uses Its own unique nomenclature and thus Introduces some 
ambiguity, certain overlapping of the terms can be observed. Some examples 
are listed below. 

Factor I. Personal Poc fercVr 

Systematized Energy (Nunnally, Thlstlethwaite, and Wolfe, 1963) 

Lethargy vs. Energy (Solomon, Bezdek, and Rosenberg, 196A) 

Teaching Dynamism (Gulo, 1966) 

Potency (Scheln and Hall, 1967) 
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Factor II. Pragmatism. 

Organization Behavior (Gibb, 1955) 

Structure (Isaacson^ McKeachiei and Mllhollandi 1963; 
Deshpandei Webb» and Marks » 1970) 
Factor III. Amicability . 

Empathy (Staalzried and Remmers, 1943; Coffman, 195A) 

Empathetic (Bendig, 1955) 

Friendly Democratic Behavior (Gibb, 1955) 

Wannth-Coldness (Solomon, Bezdek, and Rosenberg, 1964) 

Acceptance-Change (Gulo, 1966) 

Supportiveness (Schein and Hall, 1967) 

Rapport (Deshpande, Webb, and Marks, 1970) 
Factor IV. Intellectual Competency * 

Academic Emphasis (Gibb, 1955) \ 

Competence (Bendig, 1955) ^ 

Skill (Isaacson, McKeachie, and Mllholland, 1963) 

Competence (Schein and Hall, 1967) 

Content Mastery (Deshpande, Webb, and Marks, 1970) 

Analytic-Synthetic (Hlldebrand and Wilson, 1970) 
The apparent commonality of elements within the various factor group- 
ings provides confidence that relevant teacher behavior patterns have been 
identified, at least to the extent that these can be subjectively 
determined. 

2. Although the criteria assessed different aspects of teaching 
behavior, they were significantly intercorr^lated, with the greatest degree 
of association occurlng between the Osgood and Fequod instruments. 
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Insert Table 2 about here 



These results are similar to those obtained by Maslow and Zimmerman 
(1956) who obtained a correlation of »76 between student ratings of 
Insti^ctora "as a teacher" and "as a personality/' 

In Interpreting the significance of the intercorrelatlons In Table 2, 
It should be noted that the possibility of contamination from halo effect 
(Cronbachy 1960) ^ a common problem In many studies. Is not an Issue here. 
In this study» methodological procedures made It Impossible for any 
systematic bias to carry over from one Instrument to another f.lnce each 
of the Instruments was administered to different populations of students^ 
under different conditions » and at different points In time. 

Critics of student evaluation frequently cite student grades as a 
source of halo effect In producing biased judgments of effectiveness* 
However, previous research has shown that grades have little direct 
relationship to student ratings (Remmers, 1930; Elliott, 1950; Hudelson, 
1951; Voeks and French, 1960; Lehmann, 1966; Rayder; 1968; Caffrey, 1969). 
Results obtained In this study are similar to those of other researchers, 
namely, that l.he grades an Instructor gives and the student evaluations 
he receives are not related. Correlation of average grade each Instructor 
asslgiied with Instructor mean IR rating using the Spearman rho formula 
produced a correlation coefficient of .13. 

Costln, Greenough, and Menges (1971) review other assumed relation- 
ships and find low order rel$tlon$» It was therefore concluded that the 
slg^ilflQfi^nt Intercorrel among the thre^ criteria were not the result 
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of biased student Judgments but that they did, in fact, reflect a strong 
Interrelationship among three different dimensions of teacher behavior, 
3. In order to study the relationships between the Osgood factors 
and the teaching effectiveness criteria, analysis of variance tests were 
made comparing high and low groups on each factor to the IR and Pequod 
ratings. High groups contained factor scores above the mean; low groups 
contained factor scores at or below the mean# The decision to divide 
the scores into high-low groups resulted from uncertainty about the mean 
ing of the Intervals between individual raw scores. Somewhat greater 
confidence could be placed in observations based on differences between 
groups rather than differences among individuals « Table 3 reports the 
results of the analyses. 



Insert Table 3 about here 



These results show very large and statistically significant differences 
between the high and low groups for every factor in relation to the mean 
ratings of effectiveness on both the IR and Pequod. It is therefore con- 
cluded that meaningful patterns of social behavior have been identified, 
and these patterns appear to be directly related to students^ perceptions 
of teaching competency* 

A. In order to ascertain more specifically the relationship of the 
Osgood factors to the other criterion measures of effectiveness, multiple 
regression analyses were cartied out* The following results were obtained: 
Predicting to Pequod, the multiple correlation (R) for the four factors 
was .88. The step-wise values of the multiple correlation of R were 
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Intellectual Competency) .78; Pragmatism* .83; Personal Potency, .87 
Amicability, •88. Predicting to IR, the multiple correlation was ,S0* 
The step-vise values of the multiple correlation were Intellectual 
Competency, •74; Personal Potency, .79; Pragmatism, .80; Amicability, .80. 
In both cases, the resulting F-ratios were statistically significant 
beyond the .01 level. 



Insert Table A about here 



'ihese findings are important for they demonstrate th^ possibility 
of predicting a faculty member* s success in the classroom on the basic 
of his perceived personality characteristics* 

Discussion and Conclusions 
While correlation analysis is not causal and an uncertainty remains 
as to whether or not faculty who are dynamic, pragmatic, amicable, and 
highly intellectually competent are judged to possess these attributes 
because of the way they teach, or vice versa, the evidence leans toward 
the importance of the personal characteristics as the cause of the per- 
ceived instructional effectiveness. If this interpretation is correct, 
colleges wishing to improve teaching performance face a difficult problem. 
While not known from a longitudinal study, it nonetheless seems reasonable 
th^t the personality characteristics are more enduring and therefore more 
difficult to change than are the functional behaviors typically associated 
with good teaching— clearness of assignments, fairness of tests, good use 
of clase t^me, and the like (items from IR and Pequod). A prof essor wish- 
ing to improve his perceived effectivoness may best begin on personal 
attributes rather than focusing his energy on course functions and 
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actlvltes which, on the surface seem more readily open to alteration. 
Similarly, when a college selects a new colleague from a pool of recruits, 
the findings suggest careful attention should be paid to **extra** profess- 
lonal characteristics, If the Institution places a high value on student 
judgment of teaching. 

As for future research, a study needs to be conducted on a larger 
and more diverse population of faculty so as to test the degree to ^v^hich 
generalizations apply. Also, both student-perceived teaching effective- 
ness and faculty personal characteristics need to be related to actual 
student goal attainment. Too few studies link the two. A few exceptions 
can be noted (Solomon, Rosenberg, and Bezdek, 1964; Cohen and Berger, 
1970; McKeachle, Lin, and Mann, 1971; Rodin and Rodin, 1972; Granzln and 
Painter, 1973; Gessner, 1973). Even here, however, contradictory results 
(correlations of +.77 to -♦75) create uncertainties as to the actual 
relationship between student-rated teaching effectiveness and accomplish- 
ment in courses. Confusions in this critical area contribute to low 
correlations between administrator, peer, self, and student ratings of 
teaching effectiveness (Blackburn and Clarke, 1974). Furthermore, such 
ambiguities undoubtedly heighten faculty stress and thereby Impede 
progress toward the very goal they desire, increased teaching effective- 
ness (Clark and Blackburn, 1973). Research is urgently needed on teach- 
ing effectiveness and the evaluation of faculty job performance if sub- 
stantive improvement is to be made in the quality of the educational 
process. 
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Footnote 

^One exception was made In the case of the adjective palt» strong/ 
weak. This item loaded on Factor I at ,67 and on Factor IV at .50, It 
was It^.cluded as a cotuponent of Factor I because of the relatively 
greater magnitude of the loading on that factor as well as the apparent 
conceptual consistency of the Item vlthln Factor I* 
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TABLE 1 

Factors and Factor Loadings of Student Perceptions 

of Faculty on the Oscood Effectiveness Rating 
(Number of Faculty»75; Number of Student Rater8*850) 









>> 

Li 










H 








gmatd 


1 
1 


H 4J 
H ^ 






Pra 


as 


ITEM 


I 


II 


III 


IV 




.84 




.04 


.09 


Aggresslve/Unaggresslve • . • 


.82 


1 ft 


.13 


.12 


Extroverted/ Introverted . . . 


.80 


1 K 


.28 


.10 




.76 


n7 
• U7 


,25 


.34 




.73 


.04 


.17 


.16 




.67 


.19 


.22 


.50 


Good/Poor Communicator . . . 


.57 




.22 


.41 




.54 


.09 


.30 


.31 


Practical/ Impractical .... 


.24 


.75 


.22 


.28 


Predlctable/Unpr»>dlctable • . 


.11 


.73 


.00 


.12 


Sensitive/Insensitive «... 


.12 


.13 


.76 


.23 


Open-Mlnded/Closed-Mlnded . . 


.29 


-.01 


.73 


.24 




.27 


.17 


.72 


.14 


Reasonable/Unreasonable . . • 


.41 


.34 


.53 


.28 




-.01 


.22 


.46 


.26 




.10 


.17 


.20 


.85 


Knowledgeable/Unknowledgeable 


.13 


.08 


.18 


.77 




.16 


.33 


.23 


.70 




.44 


.42 


.03 


.64 




.21 


.28 


.25 


.59 




.27 


.37 


.28 


.52 


Senslbi^/Not Sensible .... 


.18 


.39 


.29 


.47 


Cumulative Proportion of 










Total Variance^ 


.52 


.60 


.66 


.70 



^Based on all 30 Items* Not shown above are 3 Items which were 
otiltted either because they had high multiple loadings on two 
or core factors or because their loadings on all four factors 
were less than .45 (see kummel, l$70U4i). 



Table 2 



Inter cor relations of Criterion Measures 
based on Mean Student Ratings of 
Faculty Effectiveness 



Criterion Measures 



IR 

Osgood 
Pequod 



IR Osgood 
N r N r 



A5 .77* 

63 .73* 75 .86* 



*p < .01 
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TABLE 3 



Sutnmary of Analyses of Variance of Osgood Factors 
and Faculty Ef fuctlveness Ratings 



Factor 




Measures o£ 


Effectiveness 




IR 


Pequod 


Number 


Faculty 
Mftan Rating* 


Standard 
' Deviation 


W 

1 
1 


In 


Standard 
Deviation 


I. 


Personal Potency: 
















Group 1 — Low 


20 


6.45 


.85 






3.73 




Group l~High 


25 


7.40 


.42 


40 


31.60 


3.41 




F- ratio 




22.40 






36.40 




II. 


Pragmatism*. 
















Group 1 — Low 


17 


6.67 


.79 


30 


26.52 


4.30 




Group 2— High 


28 


7.17 


.74 


45 


31.10 


3.32 




F-ratio 




4,30 






26.20 




III. 


Amicability : 
















Group 1--L0W 


23 


6.67 


.83 


40 


26.91 


3.81 




Group 2— High 


22 


7.30 


.62 


35 


31.97 


3.25 




F-ratio 




7.79 






36.60 




IV. 


Intellectual 
















Competency 
















Group 1 — Low 


17 


6.27 


.79 


30 


26.17 


3.60 




Group 2~High 


28 


7.41 


.41 


33 


31.98 


2.93 




F-ratlo 




37.60 






57.50 





Note.— All F-ratlos are statistically significant beyond the .001 level. 
^Maxlttuia possible scores: IR-9..00; Pequod"40.00. 



Table 4 

Step-wise Regression Analyses Using Mean Factor Ratings 
to Predict to Mean Ratings of Teaching Effectiveness 



Step 
No. 


Factor 


F-level 


Coef. 
of 
Mult 
Regr. 


Coef. 

of 
Deter. 


I .or . in 
Coef. 

of 
Deter. 


Prediction to Pequod Ratings 
Number of Faculty-75 


1 


IV. Intellectual 
Competency . . 


115.12 


.78 


.61 


.61 


2 


II. Pragmatism . . 


21.37 


.83 


.70 


.08 


3 


I. Personal 

Potency . . . 


17.63 


.87 


.76 


.05 


4 


III. Amicability . 
P-ratio: 60.39* 


4.68 


.88 


.77 


.01 



Prediction to IR Ratings 
Number of Faculty«45 



1 


IV. Intellectual 
Competency. . 


53.17 


.74 


.55 


.55 


2 


I. Personal 

Potency . . . 


9.06 


.79 


.63 


.07 


3 


II. Pragmatism . . 


1.17 


.80 


.64 


.01 


4 


III. Amicability . 
F-ratio: 18.00* 


.03 


.80 


.64 


.00 



*p < .01 



